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Abstract — This paper studies the problem of scheduling in 
single-hop wireless networks with real-time traffic, where every 
packet arrival has an associated deadline and a minimum fraction 
of packets must be transmitted before the end of the deadline. 
Using optimization and stochastic network theory we propose a 
framework to model the quality of service (QoS) requirements 
under delay constraints. The model allows for fairly general 
arrival models with heterogeneous constraints. The framework 
results in an optimal scheduling algorithm which fairly allocates 
data rates to all flows while meeting long-term delay demands. We 
also prove that under a simplified scenario our solution translates 
into a greedy strategy that makes optimal decisions with low 
complexity. 

Index Terms — Wireless networks, ad hoc networks, quality of 
service, scheduling, real-time traffic. 



I. Introduction 

IN this paper we study the problem of scheduling real- 
time traffic in ad hoc networks under maximum per- 
packet delay constraints. The problem of scheduling best-effort 
traffic, which is defined as traffic that does not have any kind 
of quality of service (QoS) requirements such as minimum 
bandwidth or maximum delay, has been extensively studied 
for the case of wireless networks. An optimization framework 
for resource allocation in wireless networks has been devel- 
oped in (I)-|5), where a dual decomposition approach was 
used to derive various components of the resource allocation 
architecture such as scheduling, congestion control, routing, 
power control, etc. A striking feature of the solution is an 
alternative derivation of the maxweight algorithm proposed in 
0. We refer the readers to ID, for a survey of these works. 
Scheduling algorithms for packets with strict deadline re- 
quirements have been proposed in |[T0l - lfT3l . but the solutions 
are only approximate. In lfT4ll - lfT3| . the problem of optimal 
admission control and scheduling for real-time traffic was 
addressed for access-point wireless networks in which only 
one link can transmit at any given time. Among the many 
contributions in these papers is a key modeling innovation 
whereby the network is studied in frames, where a frame is 
a contiguous set of time-slots of fixed duration. Packets with 
deadlines are assumed to arrive only at the beginning of a 
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frame and have to be served before the end of the frame 
according to some specified deadlines. 

The problem of optimal congestion control and scheduling 
for general ad hoc networks and arrivals was studied in ifTTll . 
using the modeling paradigm of frames proposed in FBI . 
The model allows a common framework for handling both 
best-effort and real-time traffic simultaneously, but it can only 
handle homogeneous per-packet delay requirements. 

In this paper, we further extend the results of IfTTll for the 
case of heterogeneous delays and more general arrival models, 
and study the impact of acknowledgments on scheduling in a 
lossy channel. 

The main contributions of this work are summarized as 
follows: 

1 ) We present an optimization formulation for the problem 
of scheduling real-time traffic under maximum per- 
packet delay constraints in wireless ad hoc networks. 
Unlike earlier work, the formulation allows for general 
arrival models with heterogeneous delays. 

2) Using duality theory and a decomposition approach, we 
design an optimal scheduler that fairly allocates data 
rates to all links and ensures that a required fraction of 
each flow's packets are delivered before the prescribed 
deadline by appealing to connections between Lagrange 
multipliers and service deficits. 

3) We prove that the scheduler meets all the QoS require- 
ments and that converges to the optimal solution. 

4) We then consider noisy channels where the transmitter 
does not have perfect channel state information and 
relies on feedback (acknowledgment) from the receiver 
to find out if a transmission was successful. We derive 
the structure of optimal scheduling algorithms in this 
case and show that in the special case of colocated 
networks, the scheduling algorithm reduces to a simple 
greedy algorithm. The last part recovers a key result in 
[14] using a different approach. 

The paper is organized as follows. Section [TT] presents the 
network model we use in this work. The optimization formula- 
tion is presented in Section [Til] for the simplest of the channel 
models we study, while the dual decomposition approach 
is developed in Section [IV] The optimal scheduler and its 
convergence properties are presented in Section [V] Since we 
study three different channel models, in Sections [Vl] and IVIII 
we highlight the differences between the simplest channel 
model and the other two, and show the relationship between 
feedback after every transmission and algorithm complexity. 
In Section IVIIII we perform a simulation study to understand 



the rates that can be achieved under different channel models. 
Finally, in Section HXl we present the conclusions. 

II. Network Model 

In this section we present our model for a network com- 
posed of single-hop traffic flows, such that each packet has 
maximum delay requirements. 

We represent the network using a directed graph Q = 
(Af, £), where Kf is the set of nodes and C is the set of links, 
such that for any ni,ri2 £ A/\ if (ni,n2) G C then node n\ 
can communicate to node n<i,. Links are numbered 1 through 
|£|, and by abusing notation, we will sometimes use I G £ to 
mean I G {1,2, .. ., |£|}, 

Time is assumed to be divided in slots, and a set of T 

def 

consecutive slots is called a. frame. Let 7~~ = {1, . . . , T}. We 
denote by a — (ait)ieC,teT me number of packet arrivals at 
a given frame for link I at time slot t, and assume that we 
get to know a at the beginning of the frame. Furthermore, 

def 

assume that a/ = YlteT ait * s a ran dom variable with mean 
A; and variance af, such that Pr(ai — 0) > and Pr(ai = 
1) > 0. The last two assumptions are used to guarantee that 
the Markov chain to be defined later is both irreducible and 
aperiodic, but they can be replaced by similar assumptions. We 
further assume that arrivals are independent between different 
frames. 

Define T t a = {t : t G T and a lt > 0} to be the set of 
arrival times at link I. Let r = (Ti t )i e c.teT a be the deadline 
associated with packet arrivals. That is, a packet that arrived 
at link I, time t, must be transmitted by the end of time slot 
Tit. We assume that the deadlines are such that 



{ti, . . . , t Ui } n {t 2 , . . . , tu 2 } = for all t x , t 2 G % a 



and 



T U <T for all le C,teTi a . 



In other words, packets must be transmitted before the next 
set of arrivals occurs in subsequent time slots, and all packets 
must be transmitted before the end of the frame. 

If a packet misses its deadline it is discarded, and it is 
required that the loss probability at link I G C due to 
deadline expiry must be no more than pi. To avoid unnecessary 
complexity in the formulation, we will write a to denote both 
the number of packet arrivals and its associated deadlines r. 

This paper studies the cases where the channel state is 
assumed to be constant for the duration of a frame and when 
it is allowed to change from time slot to time slot. In both 
cases we assume the state is independent between frames 
and independent of arrivals. When the channel is fixed in a 
frame, let c = (q)ig£ denote the number of packets link I 
can successfully transmit in a time slot. When the channel is 
allowed to change, define c = (cu)ieC,teT to be the number 
of packets that can be successfully transmitted at link I in time 
slot t. 

If we get to know the channel state before transmission, we 
can determine the optimal rate at which we can successfully 
transmit, possibly allowing more than one packet to be trans- 
mitted in a single slot. On the other hand, if the channel state is 



not known, we can only determine whether a transmission was 
successful or not after we get some feedback from the receiver. 
In this paper we try to capture these different scenarios in the 
following cases: 

1) Known channel state: It is assumed that q is a non- 
negative random variable with mean q and variance a^ L , 
and we get to know the channel state at the beginning 
of the frame. 

2) Unknown channel state, per-frame feedback: It is as- 
sumed that q is a Bernoulli random variable with mean 
q and we only get to know the channel state at the end 
of the frame. In other words, the receiver acknowledges 
receptions for the all the packets in the frame, at the end 
of the frame. 

3) Unknown channel state, per-slot feedback: It is assumed 
that cu is a Bernoulli random variable with mean q and 
we get to know the channel state at the end of the time 
slot. In other words, acknowledgments are received after 
each transmission. 

In the known channel state case we can potentially send 
more than one packet in a time slot at higher rates since chan- 
nel estimation allow us to determine the optimal transmission 
rate. This is the reason why we make no assumptions on the 
values q can take since it will be determined by the particular 
wireless technology used. In the case where the channel is 
unknown before transmission we assume that we only get 
binary feedback in the form of acknowledgments, which is 
reflected in the Bernoulli assumption on q and q t . Thus, in 
this case, without any loss of generality, we assume only one 
packet can be transmitted per time slot per link. 

For the sake of simplicity in the presentation, we will first 
develop the known channel case and we will later highlight 
the differences between this case and the other two cases in 
Sections ED and |Vn] 

III. Static Problem Formulation 

To design our algorithm, we will first formulate the problem 
as a static optimization problem. Using duality theory, we will 
then obtain a dynamic solution to this problem and later we 
will prove its properties using stochastic Lyapunov techniques. 

Let s — {sit)iec.teT denote the number of packets sched- 
uled for transmission at link I and time slot t. We will only 
focus on feasible schedules, so if s^t > and s/ 2t > for 
any t, then links l\ and I2 can be scheduled to simultaneously 
transmit without interfering with each other. 

Since we cannot transmit more packets than what are 
available and what the channel state allows, we have the 
following constraints when the arrivals are given by a and 
the channel state is c: 



Tit 

E 

3=t 



si } < a u for all i G 7f , I G C, 



(1) 



sit = for all t G T \ U te7? {t, . . . , nt}, I € £ and (2) 

su < ci for alU G £ and t G T. (3) 

Denote the set of feasible schedules when the arrivals and 
channel state are a and c by S(a, c), capturing any interference 



constraints imposed by the network and satisfying (Q]), (0, and 
©. 

Our goal is to find Pr(s\a,c) which is the probability of 
using schedule s S S(a, c) when the arrivals are given by a 
and the channel state is c, subject to the constraint that the 
loss probability at link I 6 C due to deadline expiry cannot 
exceed pi. 

Denoting by (x{a,c) = (/iz(a,c))z e £ the expected number 
of packets served when the arrivals and channel state are given 
by a and c, respectively, we have: 

Hl(a,c) < >J 2_] s lt^' r ( s \ a y c ) f° r a h ' e £• 

s<ES(a,c)t6T 

Thus, the expected service at link I e C is given by 
/i; = y^/x;(a, c)Pr(c)Pr(a). 

a,c 

Due to QoS constraints we need at all links 

Hi > A;(l -pi), 
and to avoid trivialities, we assume that A;(l — pi) > for all 

leC. 

For notational simplicity, define the capacity region for fixed 
arrivals and channel state as 

C(a c) d = { ^ leC : there exists S G 5 ( a ' c )cW' 

where S(a, c)cu is the convex hull of S(a, c). 

Thus, the overall capacity region can be defined as follows: 



We are interested in finding \x* but not the value D(5*), so 
the problem can be simplified as follows 



msix)(wi +6i)m. 
tj.ec t—' 
lec 



(5) 



Since we are interested in solving the problem for non-negative 
values of 5i, it must be the case that /i* is as large as the 
constraints allow. Furthermore, since the objective function in 
(0 is linear, the problem can be decomposed into the following 
subproblems for fixed a and c: 

max y^iwi +Si) y~]si t . 
'lec teT 

The optimization problem can be solved using the following 
iterative algorithm, where k is the step index: 

5* (a, c, k) £ argmax N [wi + (5;(fc)]> su 



seS(a,c\ 



lec 



teT 






(i)=^^^(«, Cl i)Pr( C )Pr(«). 



a,c teT 



c dg f (m)iec ■ there exists (fn(a, c)) le c £ C(a,c) 
\ for all a, c and /i; = E[jli(a, c)} for all I £ C 

We will focus on the following static formulation for our 
problem, for some given vector w 6 W, ' : 



maxV'iUi/^ 



(4) 



And the update equation for the Lagrange multipliers is given 
by 

S t (k + 1) = {5i(k) + e[Aj(l - pi) - ^(fc)]} + : 
where e > is a fixed step-size parameter, and for any aft, 

_i_ def f „-, 

a T = max{a,U). 

With the change of variables ed(k) = 5(k), we rewrite the 
algorithm as 

s* (a, c, k) 6 arg max } \—Wi + di {k)\ 2, s it (6) 
ses(a,c) 1&C e ter 



subject to 



W >A;(l-^)foralUe£. 



/ J 7 



( fc ) = EE^( a ' c ' fc ) pr ( c ) pr ( a )> 



The vector w can be used to allocate additional bandwidth 
fairly to flows beyond what is required to meet their QoS 
needs. Other uses for w have been explored in [17|. We will 
assume that the arrivals and loss probability requirements are 
feasible and thus the optimization problem has a solution /i*. 

IV. Dual Decomposition of the Static Problem 

In this section we use duality theory to decompose the static 
optimization problem into simpler subproblems that will give 
us the ideas behind the dynamic algorithm. 

Using the definition of the dual function |[T8l . we have that 



tjec 



E 

lec 



D(8) = maxVwi/i! - Si[Xi(l - pi) -Hi]. 



From Slater's condition [19| we know that the duality gap is 

zero and therefore D(S*) = J2 w ii^h where 

lec 

5* G argminP/((5). 
<5,>o 



a,c teT 

with update equation: 

di(k + 1) = [di(k) + Ai(l -Pi) - tf(k)}} + - 

From the update equation we see that di(k) can be interpreted 
as a queue with A/(l —pi) arrivals and ]JL*(k) departures at 
step k. 



V. Online Algorithm and Its Convergence 
Analysis 

So far we have presented a dual decomposition for a static 
problem; however, the real network has stochastic arrivals and 
channel state. We will use the intuition from the decomposition 
in this section to develop an online algorithm that can cope 
with such changing conditions and prove its convergence 
properties. 



A. Scheduler 

We propose the following dynamic scheduling algorithm, 
where the arrivals and channel state in frame k are given by 
a(k) and c(k), respectively: 

s*(a(k),c(k),d(k)) G argmax ^[-wi + di(k)]^si t , 



seS(a(k),c(k))~ e 



lec 



teT 



(7) 



with update equation 

dt{k + 1) = [di(k) + a,(fc) - 7f (o(fc),c(fc),d(fc))] + , 

where 

/;(a(fc), c(fc), d(fc)) = ^ 5Ua(k), c(k), d(k)) 
ter 

and di(k) is a binomial random variable with parameters 
az(fc) and 1 — p;. The quantity di(k) can be generated by 
the network as follows: upon each packet arrival, toss a 
coin with probability of heads equal to 1 — pi, and if the 
outcome is heads, add a one to the deficit counter di(k). This 
implementation for ai(k) was first suggested in ifTTl . 

Note that in (|Tj we make explicit the fact that the optimal 
scheduler is a function of a(k), c(k), and d(k), for fixed w and 
e. Also note that di(k) can be interpreted as a virtual queue 
that keeps track of the deficit in service for link I to achieve a 
loss probability due to deadline expiry less than or equal to pi. 
The idea of using a deficit counter was first used in lfl4l for the 
case of colocated networks with homogeneous delays, while 
the Lagrange multiplier interpretation allowed us to extend the 
result to general ad hoc networks and heterogeneous delays. 

B. Convergence Results 

We now prove that the online algorithm meets the QoS 
constraints, the total expected service deficit has a 0(l/e) 
bound, and the expected value of the objective is within 0(e) 
of the optimal value of the static problem (@J. For the sake of 
readability, we defer the proofs to the appendixes. 

We will first bound the expected drift of d(k) for a suitable 
Lyapunov function. Note that d(k) defines an irreducible and 
aperiodic Markov chain. 

Lemma 1: Consider the Lyapunov function V(d) = 

^J2iec d f- If mere exists a P oint M(A) G C/(l + A) for 
some A > such that 



/xj(A) > Aj(l-pj) foralHG£ 



(8) 



then 



E [V(d(k + l))\d(k) =d]- V(d) < Bi - £ 2 53 d ' 

lec 

- - 2 {«;,(! + A)^(A) - Wl E [J,*(o(A), c(k),d)}} 



lec 



for some positive constants B\, B 2 , any e > 0, where 
I* (a(k) , c(k) , d) is obtained from the solution to 0. o 

Since the last term in the right-hand side of the inequality 
can be upper-bounded, it can be shown that the expected drift 
is negative but for a finite set of values of d(k). Thus, Lemma 



Q]implies that d(k) is positive recurrent. As a corollary of this 
result, we have that the total expected service deficit has an 
0(1/ e) bound. 

Corollary 1: If there exists a point /x(A) G C/(l + A) for 
some A > such that dD holds true, then the total expected 
service deficit is upper-bounded by 



lim sup E 



5>(*o 



.lec 



<B, 



e 



for all I G C, where B 3 = Bi/B 2 and B± = J^iec Wi\i/B 2 .<> 
Lemma Q] also implies that the scheduler fulfills all QoS 

requirements. 

Corollary 2: If there exists a point /x(A) G C/(l + A) for 

some A > such that ([H} holds true, then the online algorithm 

fulfills all the QoS constraints. That is: 



lim inf E 

K-xx 



1 K 
-J2 T t(^),c(k),d(k)) 



fe=i 



>Aj(l-pj) 



for all I G £. o 

The above corollary states that the arrival rate into the deficit 
counter is less than or equal to the service rate. The result is 
an obvious consequence of the stability of the deficit counters 
and so a formal proof is not given. 

In order to be able to prove that our scheduler achieves the 
optimal solution to the static problem in an average sense, a 
related result to Lemma Q] must be stated first. Since the proof 
is similar to the proof in Lemma [T] it is omitted. 

Lemma 2: Consider the Lyapunov function V(d) = 
lE^-Then 



E[V(d(k + l))\d(k) = d] -V(d) <Bi~B 5 ^di 

lec 

--52{wirf -wiE[i:(a(k),c(k),d)}} 

lec 

for B\ > 0, some non-negative constant B$, any e > 0, where 
H* is a solution to (O, and I* (a(k) , c(k) , d) is obtained from 
the solution to (0. o 

Using Lemma [2] we can now prove that our online algorithm 
is within 0(e) of the optimal value. 

Theorem 1: For any e > we have that 



lim sup_E 

K— >oo 



53 w n4 

lec 



Wl 



1 K 
-53/f(a(fc),c(fc),d(A:)) 



fc=i 



< Be 



for some B > 0, where /j* is a solution to @, and 
I* (a(k) , c(k) , d(k)) is obtained from the solution to Q. o 

Both Corollary Q] and Theorem Q] highlight the trade-off in 
choosing e: the closer we get to the optimal value for the static 
formulation, the more the aggregate in the deficit counters will 
increase. 

The statement and proofs of Lemma 03 and Theorem Q] 
follow the techniques in lfT7l . which are similar to the tech- 
niques in 0. Slightly different results can be derived using 
the techniques in ||4] and QJ. 



VI. Unknown Channel State, Per-Frame Feedback 

Since the analysis for the unknown channel state, per-frame 
feedback case is similar in nature to the known channel case, 
in this section we will only highlight the differences between 
both cases. 

Remember that we assume that the channel at link I G C, 
ci, is a Bernoulli random variable with mean q, and we get 
to know the channel state only at the end of the frame. Thus, 
the set of feasible schedules when the arrivals are given by 
a is the set of schedules that capture any interference con- 
straints imposed by the network and that fulfill the following 
constraints: 



Tit 

E 



sij < au for all te^,Is£, 



(9) 



s H = for all t er\U te? {t, . . .,r lt }, I G C, and (10) 
su < 1 for all I € £ and t e T. (11) 

From our assumption that the channel state remains constant 
for the duration of a frame, (0 and ( fTOb tell us that we should 
not schedule a link for transmission more than the number 
of packets that are available, since extra transmissions do 
not increase the number of successes. Furthermore, since the 
channel is Bernoulli, when a link is scheduled it can only 
transmit at most a packet, as the constraint in (fTTT i indicates. 
Let S(a) denote the set of feasible schedules when the arrivals 
are given by a, capturing any interference constraints given by 
the network and fulfilling ©, ([Toll, and (ITTb . 

Following the same arguments as in Section [Till we have 
to design a scheduling strategy Pr(s\a) that is the probability 
of using schedule s G 5(a) when the arrivals are given by a. 
Since we cannot base our policy on the state of the channel, 
as we did before, the expected service to link I G C is now 
given by 



/'•/ 



<J2 E ^cis H Pr(s\a)Pr(c)Pr(a). 



sES(a)t£T 



Simplifying the equation we get 



in 



< 



J2 U ^c lSlt Pr(s\a)Pr(a). (12) 

a s£S{a) teT 



That is, the expected service depends on the average channel 
state. Properly modifying the definition of the capacity of the 
network, we can write the static formulation as in (0]). 

Using the dual decomposition technique of Section [TV] we 
can develop the design ideas behind the following dynamic 
scheduler, assuming that at frame k the arrivals are given by 
o(Jfe): 

s*(a(k),d(k)) G argmaxV^-w; + rf;(fc)]c; V^ Su, (13) 
ses(a{k)) lGC e tGT 

with update equation 

di(k + 1) = [di(k) + oj(fc) - J,*(o(fc), d(k))} + , 



where 



/r(a(fc),d(fc))=Y>7 f ( a (fc),d(fc)) 



and hi (k) is a binomial random variable with parameters ai (k) 
and 1 — pi. 

The main difference in the scheduler compared to the known 
channel case is that the algorithm now uses the expected chan- 
nel state in making scheduling decisions. Thus, the algorithm 
needs to know or estimate q. 

Using the same techniques as in Section IV-BI we can prove 
that the scheduler meets all the QoS requirements, the total 
expected service deficits have an 0(1 /e) bound, and the mean 
value of the objective is within O(e) of the optimal value. 

VII. Unknown Channel State, Per-Slot Feedback 

Compared to the previous two cases, the per-slot feedback 
case is more complex due to the fact that we can use the 
feedback to update our decisions at every time slot. In this 
section we will first formulate the problem focusing on policies 
rather than on schedules, and we will show that no simple 
decomposition can be achieved for this case. However, we 
will prove that for a simple scenario a greedy solution can 
achieve the optimal solution. 

A. Problem Formulation and Solution 

Similar to the development in Section [VlJ we will only 
highlight the differences between this case and the known 
channel state case. 

As described in Section [II] the channel at link I G £, time 
slot t G T, Qt, is assumed to be a Bernoulli random variable 
with mean q. Thus, instead of choosing a schedule for the 
entire frame, we will try to find a scheduling policy p that 
makes decisions at every time slot based on the feedback 
received. Note however that if the arrivals and channel state at 
a given frame are given by a and c respectively, policy p will 
generate a schedule by the end of the frame. We will denote 
by s(p,a,c) such schedule. 

We only focus on feasible policies, which are defined to be 
policies that generate a schedule that meets all interference 
constraints given by the network and fulfill the following 
constraints, for fixed p, a, and c: 

s H (p,a,c) = for all t G T\U te7? {£, . . .,t h }, I G C, (14) 

su(p, a, c) < 1 for all/ G C and t € T, and (15) 



Tit 



j=t 



CijSij (p, a, c) < an for all t G T L a , I G C. 



(16) 



teT 



Note that (fl4"l i specifies that a link should not be scheduled 
if there is no packet to be transmitted, (fT3T > states that we 
cannot schedule more than a packet in a time slot since the 
channel is Bernoulli, and ( TToT l specifies that a feasible policy 
cannot have more successful transmissions than the number of 
packets available. 

We highlight the fact that since there is only a finite number 
of feasible schedules, then the set of feasible policies is finite. 
We will denote by V(a) the set of feasible policies that meet 
all interference constraints and that fulfill (TBl i. &151 . and dT6i l. 
when arrivals are given by a. 

Our goal is to find the probability distribution Pr(p\a) of 
using policy p G V(a) in a given frame when arrivals are given 



by a, such that the fraction of packets that miss the deadline 
at link I cannot exceed pi. Thus, the expected service at link 
I G C is subject to the following constraint 

W<53 53 ^2 c it s it(p,a,c)Pr(p\a)Pr(c)Pr(a). 

a,c p€V(a) t£T 

Therefore, the optimization problem is as follows, for a 
given vector w G K\ : 



max 2, w iPi 

u.Pr(p\a) — ( 

p ' VFI ; lee 



(17) 



subject to 



W < 53 53 53 c '* s '*(-°' a ' c)Pr(p|a)Pr(c)Pr(a) for all I 

a,c peV(a) teT 

Hi >Ai(1-Pi) for all? e£ 
Pr(p|a) > for all p e V{a),a 

53 Pr (/°h) < l for a11 a - 

pe-p(a) 

We will assume that the arrivals and loss probability require- 
ments are feasible and thus the optimization problem has a 
solution pf . 

Following the arguments in Section |IV] we can develop 
the design ideas behind the following dynamic scheduler, 
assuming that at frame k the arrivals are given by a(k) and 
the channel state by c(k): 

p*(a(k),d(k)) £ argmax ^[-wi + di(k)]p,i(p,a(k)) (18) 

P ev(a(k)) ll£C e 

with update equation 

di(k + 1) = [di(k) + ai{k) - It(a(k),c(k), d(k))}} + , 
where 

Hl(p, a(k)) = 53 53 c '* s "(^' °( fc )' c ) Pr ( c )> ( 19 ) 
c teT 

It(a(k),c(k), d(k)) = 5] c lt (k) Slt (p*(k), a(k),c(k)), 

p*(k) = p*(a(k),d(k)), and a;(fc) is a binomial random 
variable with parameters ai(k) and 1 — pi. 

We note that compared to the known channel case, the 
algorithm needs to know the probability distribution of c in 
order to make optimal decisions. From (fT8l we see that the 
duality approach does not give us a simple decomposition as in 
((6). The reason comes from the fact that even though per-slot 
feedback may help us to potentially increase the throughput, 
it also increases the complexity of the decision algorithm. 

Using the same proof techniques as in Section IV-BI it can 
be proved that the scheduler meets all the QoS requirements, 
the total expected service deficits have an 0(1 /e) bound, and 
the mean value of the objective is within O(e) of the optimal 
value. 



B. A Greedy Strategy for Colocated Networks 

In this Section we will show that in a simple scenario 
a greedy algorithm can achieve the optimal solution with 
minimum complexity. To do that, we will focus our attention to 
colocated networks, where only one link is allowed to transmit 
at any given time slot. We will also assume that the channel 
state is independent between different time slots. Furthermore, 
we will assume that at every frame there is a single packet 
arrival at every link at the beginning of the frame, and that all 
the packets must be transmitted by the end of the frame. That 



is, 



Ti a = {1}, an = 1, and m = T for all I e C. 



(20) 



The key idea we will use in this section is that for a given 
frame when the deficit counters are given by d, links will be 
prioritized in decreasing order of the priorities [-Wi + di]ci. 

Definition 1: A greedy policy for colocated networks is a 
scheduling policy that at every time slot schedules a link with 
the highest priority {-wi + di]ci among the links that have a 
packet that remains to be transmitted. o 

Theorem 2: The greedy scheduler is the optimal solution 
to (fT8l for colocated networks, when the arrivals are given by 
(l20l i. and the channel state is independent between different 
time slots. o 

For ease of readability, we defer the proof to the appendixes. 
Due to the optimality of the policy, and following a similar 
development as in Section IV-BI one can prove that the greedy 
algorithm meets all the QoS constraints, the total expected 
service deficits have an 0(l/e) bound, and the mean value of 
the objective is within 0(e) of the optimal value. We skip the 
proofs since they are analogous to the ones already presented. 

The above theorem shows that the dual decomposition so- 
lution presented here recovers the solution for the special case 
of access-point networks presented in [14|. The contribution 
of this section is to show that the dual approach allow us to 
extend such results for very general ad hoc networks, arrivals, 
and for heterogeneous delays, and that |[T4l can be seen as a 
particular case of our general formulation. 

VIII. Simulations 

The purpose of the simulations is to compare the throughput 
that can be achieved for the different channel models. To do 
that, we simulate a 10-link network such that its interference 
graph is given by Fig. Q] where each vertex of the graph 
represents a link and the edges represent the interference 
constraints. For example, if link 1 is scheduled, then links 
2, 4, and 7 cannot be activated. This interference graph was 
first used in ifPTl . 

The constraint for the dropping probability due to deadline 
expiration is set to 0.1, the packet arrivals at every link are 
assumed to be Bernoulli random variables with mean 0.6 
packets/frame, and a frame has 3 time slots. Every channel 
is assumed to be a Bernoulli random variable with mean 0.96. 
We will compare the three channel models studied in this 
paper: known channel state, unknown channel state per-frame 
feedback, and unknown channel state per-slot feedback. The 
simulation time is 10 6 frames. 




Fig. 1. Interference graph used in the simulations 
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Fig. 2. Average service when wi = 



In Figs. H] and [3] we plot the average service for different 
values of Wi. The case wi = means that we are only 
interested in finding a feasible solution without any concern 
of optimality. This results in a rate assignment that is only 
slightly above the minimum required to achieve an acceptable 
dropping probability, as shown in Fig. [4] In the case wi = 6 
we have that the algorithm tries to maximize the service rate 
for all links, resulting in a significant decrease of the dropping 
probability as shown in Fig. [5] This result suggests that the 
objective function not only has a role giving priorities to links 
according to its weights, but also has a role in decreasing 
the dropping probabilities, allocating any available capacity to 
links. 

It is interesting to note that the difference in service rates 
for the different channel models is smaller than 2%, which 
suggests that the added complexity in solving the optimal 
scheduler for the per-slot feedback case does not compare with 
the gains that can be achieved in terms of throughput. Thus, 
the per-frame feedback case can be used as a low-complexity 
approximation to the per-slot feedback case. 

IX. Conclusions 

In this work we have presented an optimization formulation 
for the problem of scheduling real-time traffic in ad hoc 
networks under maximum delay constraints. The model allows 
for general arrival models with heterogeneous delay con- 
straints. Using duality theory and a decomposition approach, 
we presented an optimal scheduler and proved that it fairly 
allocates data rates to all links and guarantees that the delay 
requirements are met at every flow. We further studied the 
impact of feedback at every time slot on the complexity of 
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the optimal algorithm, and showed that for a certain simple 
scenario a greedy strategy can achieve the optimal solution 
with low complexity, recovering the results of 1 14 1 for access- 
point networks. 



Appendix A 
Proof of LemmaU 

Before we prove Lemma [TJ we present the following fact. 
Fact 1: The optimization in (O can be performed over 
S(a(k),c(k))cn, the convex hull of S(a(k),c(k)); that is, 



argmax ^[-wi +rf;(fc)]^ 



seS(a(fc),c(fe))~ e 



Sit 



lee 



teT 



argmax y^-w; + d;(fc)] } y 



s eS(o(/c), c (fc)) CH f. : e 



su- 



lec 



teT 



The reason for this comes from the fact that the objective 
function is linear and therefore there must be an optimal point 
s*(a(k),c{k),d(k))€S(a(k),c(k)). ' ' o 
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Proof of Lemma [7} 

E[V(d(k + l))\d(k) = d]-V(d) 

=E 



<E 



--E 



^{[d i + aKA;)-/f(a(fe),c(A ; ),d)] + } 

lec 

|X>+5,(*) -■?(<*(*)> c(fc),d)] 



lec 



E 

lec 



El 

ze£ 



<£ 



;e£ 



J2di[ai(k) - It(a{k),c(k),d)} 

lec 

ze£ 

53djoj(fc) - dil?(a(k),c{k),d) 

lec 

ze£ 

<B 1 +J2dM 1 -Pi) 

ec 

J2(- w i + d i) J t(a(k),c(k),d) 

iec^ e ' 

-J2-wiI?(a(k),c(k),d) 

lec 

e£ 

lec \ e ' 

^2- Wl It(a(k),c(k),d) 



where ( |2TT i follows from the definition of I*(a(k),c(k),d), 
< f22b follows from (|8), and 

Si = i £>? + <r?)[l + (1 - pO 2 ] + A,p«(l "«)• 

ze£ 

Given the definition of C, we have that /i(A) G C/(l + A) 
implies that there exist p,(a, c) G C(a, c) for all a, c and (1 + 
A)/i;(A) = E[p,i(a, c)] for all / G £. For the rest of the proof 
we define p,(a(k) , c(k)) to be such set of values associated to 
(1 + A)(u(A). Hence: 

£|V(d(fc + l))|d(fc) = d]-V r (d) 

<B 1 +Y,dim{A) 

lec 

-E W-^+d/U*(a(fc),c(AO,d) 
.lec ^ e ' 

+ Y J \^iE[It{a{k),c{k),d)] 
lec 
<B 1 +Y,dim(A) 
lec 

-E ^(-wi+di)p,i(a(k),c(k)) 
.lec ^ e ' 

+ Y,-™iE[I?(a(k),c(k),d)] 

lec 

=B, + J2 dtmiA) - J] (-«,* + di) (1 + A) W (A) 
lec iec^- e ' 

+ ^2-w l E[It(a(k),cik),d)] 

lec e 

=B 1 -Aj2diHi(A) 

lec 

--J2 {wi(l + A) W (A) - Wl E [It(a(k), c(k),d)]} , 



(23) 



lec 



where d23l follows from the fact that n(a(k),c(k)) G 
C(a(fc),c(fc)) and Fact[T] Therefore: 



(21) 



E [V{d{k + l))|d(fe) = d] - V(d) <B 1 -B 2 Y,di 

lec 

- - ]T {«;,(! + A)^(A) - «;,£ [Jf (a(*), c(fc),d)]} 



ie£ 



£" 



where 



B 2 = Amin{ W (A)}. 

lec 



(22) 



lec 



E 



Appendix B 
Proof of TheoremQ] 

From Lemma [2] we know that 
-^2{w lfJ ,t -wiE[It(a(k),c(k),d)}} 



lec 



lec 



<B X -B 5 ^2d L + V{d) - E [V(d(k + l))\d(k) = d] 



lec 



<Bx + V(d) - E [V(d{k + l))|d(A) = d] 
since B$ J^iec ^i — 0- Taking expectations: 



1 
e 



£{«W-«*/r(a(*).c(fc),d(fc))} 



ie£ 



<B a - E [V(d(k + 1))] + E [V(d(k))} . 

Adding the terms for k — {1, . . . , K} and dividing by K 
we get: 

K 



1 



-E 



^wini -wi—^2l[(a(k),c(k),d(k)) 
jec fe=i 

£[V(d(# + l))] , E[V(d(l))] 



<B X 



<Bi 



£[V(d(l))] 



A' 



(24) 



where ( l24l i follows from the fact that the Lyapunov function 
V is non-negative. Assuming E [V(d(l))] < oo we get the 
following limit expression: 



lim sup-E 



E 



wifJ-i - Wl 



where B = B\. 



1 K 
-J2n(a(k),c(k),d(k)) 



fe=i 



<£e 



Appendix C 
Proof of Theorem[2] 

The proof will use dynamic programming arguments: we 
will first note that if there is only one time slot remaining, 
the optimal decision is to schedule the link with the highest 
weight among the links that have a packet that remains to be 
transmitted, and then using induction we will prove that the 
best decision in any time slot is to schedule a backlogged link 
with the highest weight. 



For simplicity in notation, define 717 
I G £. Also define 



-wi 



di for all 



U p (C,j) = ^y^ ^2 TTiCi t sit(p,a,c)Pr(c) 



lec 



t=T-j+l 



to be the expected utility of policy p when there are j time 
slots remaining and the set of links that have a packet that 
needs to be transmitted is given by £. Furthermore, define 

C/ P (£,0) = 0. 

Finally, we will denote the greedy policy by g. 

If there is only one time slot remaining, the optimal decision 
is to schedule one of the links that has the largest weight 
7T/ q among the links that have a waiting packet, since this 
maximizes the expected utility. So the optimal decision is to 
use the greedy scheduler in the last time slot. Using induction, 
we assume that when there are j time slots remaining, it is 
optimal to use the greedy scheduler. We will prove that if there 
are j + 1 time slots remaining then it is also optimal to use 
the greedy scheduler. 

When there are j + 1 time slots, we need to determine 
which link to schedule in the first slot, and then use the greedy 



scheduler for the remaining j time slots. Assume that the set 
of links that have a packet waiting to be transmitted is given 
by C. If we schedule the link with the largest weight ttiCi, 
then the expected utility is given by 

U g (£,j + l) = ir l *c l *+(l-ci*)U g (£J) + c l *U g (£\{l*}J) 



where 



/* G argmax7r;C;. 
lec 



If we decide to schedule link 



I <£ argmax7TiQ, 

lec 

then the expected utility is given by 

Up(C,j + 1) =wjdi + (1 - cj)U g (C,j) + cjU g (C \ {l},j) 

=TTiCj + TTl*Cl* + (1 - Q»)(l -Cj)U g (C,j - 1) 

+ (l-c l *)c I U g (£\{l},j-l) 
+ c l *(l-c I )U g (£\{l*},j-l) 
+ ci*c l U g (£\{l*,l},j-l) 
=7tj*cj. + (1 - ci») [irjci+ (1 - cj)U g (£,j - 1) 
+c I U g (£\{l},j-l) 
+ c l ,[ n c l + (l-c ! )U g (£\{l*}J-l) 
+crU g (£\{l*,l}J-l) 



So in order to prove that U g (£,j + 1) > Up(£,j + 1) it 
suffices to show that 

U g (£,j) ^ttjcj + (1 - cj)U g (£,j - 1) (25) 

+ c f U g (£\{l},j-l) 

and 

U g (£ \ {I*} J) >7r r c r + (1 - ci)U g {£ \ {1*}J - 1) (26) 
+ c I U g (£\{l*j},j-l), 

From the assumption that the greedy scheduler is optimal when 
there are j slots remaining, it is clear that (|25T > and (|26| | are 
true, so the greedy scheduler is indeed optimal when there are 
j + 1 slots remaining. ■ 
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